Creating Private Network Overlays for High Performance Scientific Computing
Identifieur interne : 000F90 ( Main/Exploration ); précédent : 000F89; suivant : 000F91Creating Private Network Overlays for High Performance Scientific Computing
Auteurs : Edward Walker [États-Unis]Source :
- Lecture Notes in Computer Science [ 0302-9743 ] ; 2007.
Abstract
Abstract: In this paper we describe an approach in creating private network overlays in user-space to support the dynamic creation of personal clusters on-demand. These personal clusters are created by submitting job proxies to High Performance Computing (HPC) clusters. Job proxies contribute CPU resources back to the personal cluster when they eventually run, allowing application jobs to execute on them in a system call virtualized run-time environment. The virtualized run-time environment enables additional personal cluster-wide services to be interposed, including a private network overlay instantiated for each personal cluster created. The interposed private network overlay allows the personal clusters to tunnel IP traffic thorough gateway nodes at each contributing HPC cluster site in order to provision resources across private networks, survive transient network outages, support critical services like distributed filesystems, and in some cases, improve network transfer throughput across the wide-area network. This paper describes our design and implementation strategy, and concludes with some general guiding principles to aid other projects of a similar nature.
Url:
DOI: 10.1007/978-3-540-76778-7_11
Affiliations:
Links toward previous steps (curation, corpus...)
- to stream Istex, to step Corpus: 000658
- to stream Istex, to step Curation: 000658
- to stream Istex, to step Checkpoint: 000653
- to stream Main, to step Merge: 000F97
- to stream Main, to step Curation: 000F90
Le document en format XML
<record><TEI wicri:istexFullTextTei="biblStruct"><teiHeader><fileDesc><titleStmt><title xml:lang="en">Creating Private Network Overlays for High Performance Scientific Computing</title><author><name sortKey="Walker, Edward" sort="Walker, Edward" uniqKey="Walker E" first="Edward" last="Walker">Edward Walker</name></author></titleStmt><publicationStmt><idno type="wicri:source">ISTEX</idno><idno type="RBID">ISTEX:47BCA7791A5CC833C71EDDE9554C2B1D2F5494BB</idno><date when="2007" year="2007">2007</date><idno type="doi">10.1007/978-3-540-76778-7_11</idno><idno type="url">https://api.istex.fr/document/47BCA7791A5CC833C71EDDE9554C2B1D2F5494BB/fulltext/pdf</idno><idno type="wicri:Area/Istex/Corpus">000658</idno><idno type="wicri:Area/Istex/Curation">000658</idno><idno type="wicri:Area/Istex/Checkpoint">000653</idno><idno type="wicri:doubleKey">0302-9743:2007:Walker E:creating:private:network</idno><idno type="wicri:Area/Main/Merge">000F97</idno><idno type="wicri:Area/Main/Curation">000F90</idno><idno type="wicri:Area/Main/Exploration">000F90</idno></publicationStmt><sourceDesc><biblStruct><analytic><title level="a" type="main" xml:lang="en">Creating Private Network Overlays for High Performance Scientific Computing</title><author><name sortKey="Walker, Edward" sort="Walker, Edward" uniqKey="Walker E" first="Edward" last="Walker">Edward Walker</name><affiliation wicri:level="4"><country xml:lang="fr">États-Unis</country><wicri:regionArea>Texas Advanced Computing Center, The University of Texas at Austin, Austin, Texas 78758</wicri:regionArea><orgName type="university">Université du Texas à Austin</orgName><placeName><settlement type="city">Austin (Texas)</settlement><region type="state">Texas</region></placeName></affiliation><affiliation wicri:level="1"><country wicri:rule="url">États-Unis</country></affiliation></author></analytic><monogr></monogr><series><title level="s">Lecture Notes in Computer Science</title><imprint><date>2007</date></imprint><idno type="ISSN">0302-9743</idno><idno type="eISSN">1611-3349</idno><idno type="ISSN">0302-9743</idno></series><idno type="istex">47BCA7791A5CC833C71EDDE9554C2B1D2F5494BB</idno><idno type="DOI">10.1007/978-3-540-76778-7_11</idno><idno type="ChapterID">11</idno><idno type="ChapterID">Chap11</idno></biblStruct></sourceDesc><seriesStmt><idno type="ISSN">0302-9743</idno></seriesStmt></fileDesc><profileDesc><textClass></textClass><langUsage><language ident="en">en</language></langUsage></profileDesc></teiHeader><front><div type="abstract" xml:lang="en">Abstract: In this paper we describe an approach in creating private network overlays in user-space to support the dynamic creation of personal clusters on-demand. These personal clusters are created by submitting job proxies to High Performance Computing (HPC) clusters. Job proxies contribute CPU resources back to the personal cluster when they eventually run, allowing application jobs to execute on them in a system call virtualized run-time environment. The virtualized run-time environment enables additional personal cluster-wide services to be interposed, including a private network overlay instantiated for each personal cluster created. The interposed private network overlay allows the personal clusters to tunnel IP traffic thorough gateway nodes at each contributing HPC cluster site in order to provision resources across private networks, survive transient network outages, support critical services like distributed filesystems, and in some cases, improve network transfer throughput across the wide-area network. This paper describes our design and implementation strategy, and concludes with some general guiding principles to aid other projects of a similar nature.</div></front></TEI><affiliations><list><country><li>États-Unis</li></country><region><li>Texas</li></region><settlement><li>Austin (Texas)</li></settlement><orgName><li>Université du Texas à Austin</li></orgName></list><tree><country name="États-Unis"><region name="Texas"><name sortKey="Walker, Edward" sort="Walker, Edward" uniqKey="Walker E" first="Edward" last="Walker">Edward Walker</name></region><name sortKey="Walker, Edward" sort="Walker, Edward" uniqKey="Walker E" first="Edward" last="Walker">Edward Walker</name></country></tree></affiliations></record>Pour manipuler ce document sous Unix (Dilib)
EXPLOR_STEP=$WICRI_ROOT/Ticri/CIDE/explor/CyberinfraV1/Data/Main/Exploration
HfdSelect -h $EXPLOR_STEP/biblio.hfd -nk 000F90 | SxmlIndent | more
Ou
HfdSelect -h $EXPLOR_AREA/Data/Main/Exploration/biblio.hfd -nk 000F90 | SxmlIndent | more
Pour mettre un lien sur cette page dans le réseau Wicri
{{Explor lien
|wiki= Ticri/CIDE
|area= CyberinfraV1
|flux= Main
|étape= Exploration
|type= RBID
|clé= ISTEX:47BCA7791A5CC833C71EDDE9554C2B1D2F5494BB
|texte= Creating Private Network Overlays for High Performance Scientific Computing
}}
| This area was generated with Dilib version V0.6.25. |  |